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Abstract 

Budget feasible mechanisms, recently initiated by Singer (FOCS 2010), extend algorithmic mech- 
anism design problems to a realistic setting with a budget constraint. We consider the problem of 
designing truthful budget feasible mechanisms for general submodular functions: we give a random- 
ized mechanism with approximation ratio 7.91 (improving the previous best-known result 112), and 
a deterministic mechanism with approximation ratio 8.34. Further we study the knapsack problem, 
K-j which is special submodular function, give a 2 + y2 approximation deterministic mechanism (improv- 

(~o ing the previous best-known result 6), and a 3 approximation randomized mechanism. We provide a 

similar result for an extended knapsack problem with heterogeneous items, where items are divided 
into groups and one can pick at most one item from each group. 
, Finally we show a lower bound of approximation ratio of 1 + V2 for deterministic mechanisms 

f-K and 2 for randomized mechanisms for knapsack, as well as the general submodular functions. Our 

lower bounds are unconditional, which do not rely on any computational or complexity assumptions. 

o 



'Division of Mathematical Sciences, School of Physical and Mathematical Sciences, Nanyang Technological University, 
Singapore. Email: ningc@ntu.edu. sg, ngravinOpmail .ntu.edu. sg. Work done while visiting Microsoft Research Asia. 
'St. Petersburg Department of Steklov Mathematical Institute RAS, Russia. 
* Microsoft Research Asia. Email: pinyanl@microsoft.com. 



1 Introduction 

It is well-known that a mechanism may have to pay a large amount to enforce incentive compatibility 
(i.e., truthfulness). For example, the seminal VCG mechanism may have unbounded payment (compared 
to the shortest path) in path auctions [1]. The negative effect of truthfulness on payments leads to a 
broad study of frugal mechanism design, i.e., how should one minimize his payment to get a desired 
output with incentive agents? While a class of results have been established [TJ [221 EH El H] > i n practice, 
one cannot expect a negative overhead for a few perspectives, e.g., budget or resource limit. 

Recently, Singer [20J consider mechanism design problems from a converse angle and initiate the 
study of truthful mechanism design with a sharp budget constraint: the total payment of a mechanism 
is upper bounded by a given value B. Formally, in a marketplace each agent/item has a privately known 
incurred cost a. For any given subset S of agents, there is a publicly known valuation v(S), meaning 
the social welfare derived from S. A mechanism selects a subset S of agents and decides a payment pi 
to each i G S. Agents bid strategically on their costs and would like to maximize their utility pi — a. 
The objective is to design truthful budget feasible mechanisms with outputs approximately close to 
socially optimal solution. In other words, it studies the "price of being truthful" in a budget constraint 
framewortQ 

Although budget is a realistic condition that appears almost everywhere in daily life, it has not 
received much attention until very recently [7J [2j [3j EQ]. In the framework of worst case analysis, most 
results are negative [7j. The introduction of budget adds another dimension to mechanism design; it 
further limits the searching space, especially given the (already) strong restriction of truthfulness. De- 
signing budget feasible mechanisms even requires us to bound the threshold payment of each individual, 
which, not surprisingly, is tricky to analyze. 

While the problem in general does not admit any budget feasible mechanisnrl Singer |20| studied 
an important class of valuation functions, i.e., monotone submodular functions. He gives a randomized 
truthful mechanism with constant approximation ratio 112 for any monotone submodular functions, 
and deterministic mechanisms for special cases including knapsack (ratio 6) and coverage. Further, he 
shows that no deterministic truthful mechanism can obtain an approximation ratio better than 2 even 
for knapsack. 

1.1 Our Results 

In this paper, we improve upper and lower bounds of budget feasible mechanisms for general submodular 
functions and knapsack, summarized in the following table. 

In truthful mechanism design, if there is no restriction on total payment, it is sufficient to focus on 
designing monotone allocations — the payment to each individual winner is the unique threshold to 
maintain the winning status [15] . With a sharp budget constraint, in addition to monotone allocation, we 
also have to upper bound the sum of threshold payments. For submodular functions, the natural greedy 
algorithm is a good candidate for designing budget feasible mechanisms due to its nice monotonicity and 
small approximation ratio. However, the threshold payment to each winner can be very complicated 

x Note that if we do not consider truthful mechanism design, the problem is purely an optimization question with 
an extra capacity (i.e., budget) constraint, which has been well-studied in, e.g., [161 1211 IT31 [51 HI], in the framework of 
submodularity. It is well-known that a simple greedy algorithm gives the best possible approximation ratio 1 — 1/e [16] . 
When agents are weighted (corresponding to costs in our setting), the simple greedy algorithm may have unbounded 
approximation ratio [9]; a variant of the greedy by picking the maximum of the original greedy and the agent with the 
largest value provides the same approximation ratio 1 — 1/e [13] . 

2 For example, one with budget B — 1 would like to purchase a path from s to t in a network {(s, v), (v, t)} where each 
edge has incurred cost 0. In any truthful mechanism that guarantees to buy the path (i.e., outputs the socially optimum 
solution), one has to pay each edge the threshold value B, leading to a total payment 25 which exceeds the given budget. 
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"It may require exponential running time for general submodular functions. 



because an agent can bid differently to get other ranking positions in the greedy algorithm, which 
results in different ways of computing the marginal contributions for the rest agents, and therefore, 
unpredictably change the set of winners. Singer [20j bound the threshold of each winner by considering 
all possible ranking positions for his bids and taking the maximum of the thresholds of all these positions. 
In Section 3, we give a clean and tight analysis for the upper bound on threshold payment by applying 



the combinatorial structure of submodular functions (Lemma 3.2). These upper bounds on payments 



suggest appropriate parameters in our randomized mechanism, which roughly speaking, selects the 
greedy algorithm or the agent with the largest value at a certain probability. 

A difficulty of deriving deterministic mechanisms is related to the agent i* with the largest value 
v(i*) — due to its (possibly large) cost greedy may not include it, which could result in a solution with 
an arbitrarily bad ratio. However, we cannot simply compare greedy with v(i*) because this breaks 
monotonicity as i* is able to manage the greedy solution by his bid (this is exactly where randomization 
helps). To get around of this issue, we drop i* out of the market and compare v(i*) with remaining 
agents in an appropriate way — now i* is completely independent of the rest of the market and cannot 
affect its output -- this gives our deterministic mechanisms for submodular functions and knapsack 
with small approximation ratios (note that we still need to be careful about the agents in the remaining 
market as they are still able to manage their bids to beat v(i*)). 

On the other hand, it is interesting to explore limitations of budget feasible mechanisms. Singer gives 
a simple lower bound of 2 on the approximation ratio and proposes that exploring the lower bounds 
that are dictated by budget feasibility is "perhaps the most interesting question" [2D]. In Section 4, 
we prove a stronger lower bound 1 + yz for deterministic mechanisms. In most lower bounds proofs 
for truthful mechanisms, a number of related instances are constructed and one shows that a truthful 
mechanism cannot do well for all of them [5|ll2 t fT7 ] ll9j. (For example, in Singer's proof, three instances 
are constructed.) Our lower bound proof uses a slightly different approach: We first establish a property 
of a truthful mechanism for all instances provided that the mechanism has a good approximation ratio 



(Lemma 4.1 ), then we conclude that this property is inconsistent with the budget feasibility condition for 
a carefully constructed instance. Furthermore, we show a lower bound of 2 for universally randomized 
budget feasible mechanisms. Both our lower bounds are independent of computational assumptions and 
hold for instances with small number of agents. 

While submodular functions admit a good approximation budget feasible mechanism, its general- 
ization seems to be a very difficult task and there may not be any good approximation mechanisms 
for instances like path and spanning tree [20]. In Section 5, we take a first step of this generalization 
by considering an extended knapsack problem with heterogeneous items, where items are of different 
types and we are only allowed to pick one item from each type. Here we cannot apply the same greedy 
mechanism for the original knapsack as it may not even generate a feasible solution; and its approx- 
imation ratio can be arbitrarily bad if we only take the first agent from each type. To construct a 
truthful mechanism with good approximation, we employ a greedy strategy with deletions — in the 
process of the greedy, we either add a new item whose type has not been considered yet or replace an 
existing item with the new one of same type. Although there are deletions, the greedy algorithm is 



still monotone (but its proof is much more involved), based on which we have similar approximation 
mechanisms for heterogeneous knapsack. We believe that the greedy strategy with deletions can be 
extended to a number of interesting non-submodular settings to derive budget feasible mechanisms. 

2 Preliminaries 

In a marketplace there are n agents (or items) , denoted by A = {1, . . . , n}. Each agent i has a privately 
known incurred cost Ci (or denoted by c(i)). For any given subset SCiof agents, there is a publicly 
known valuation v(S), meaning the social welfare derived from S. We assume v (0) = and v(S) < v(T) 
for any ScTCi. We say the valuation function submodular if v(S) + v(T) > v(S nT) + v (S U T) for 
any S, T C A. 

Upon receiving a bid cost 6j from each agent, a mechanism decides an allocation S C yl as winners 
and a payment pi to each i £ A. We assume that the mechanism has no positive transfer (i.e., Pi = if 
i ^ S) and individually rational (i.e., Pi > h if i £ S). Agents bid strategically on their costs and would 
like to maximize their utilities, which is pi — q if 2 is a winner and otherwise. We say a mechanism 
is truthful if it is of best interests for all agents to bid their true costs. For randomized mechanisms, 
we consider universal truthfulness in this paper (i.e., a randomized mechanism takes a distribution over 
deterministic truthful mechanisms). 

Since our setting is in single parameter domain as each agent has one private cost, it is well-known |15j 
that a mechanism is truthful if and only if its allocation rule is monotone (i.e., a winner keeps winning if 
he unilaterally decreases his bid) and the payment to each winner is his threshold bid to win. Therefore, 
we will only focus on designing monotone allocations and do not specify the payment to each winner 
explicitly. 

A mechanism is said to be budget feasible if YliPi — B, where B is a given sharp budget constraint. 
Assume without loss of generality that Cj < B for any agent i £ A, since otherwise he will never win 
in any (randomized) budget feasible truthful mechanism. Our objective is to design truthful budget 
feasible mechanisms with outputs approximately close to the social optimum. That is, we want to 
minimize the approximation ratio of a mechanism, which is defined as max/ — XJr, where A4(I) is the 
(expected) value of mechanism M on instance / and opt(I) is the optimal value of the integer program: 
max SCA v (S) subjected to c(S) < B. 

3 Budget Feasible Mechanisms 

For any given submodular function, denote the marginal contribution of an item i with respect to set S 
by fns{i) = v(SD {i}) — v(S). We assume that agents are sorted according to their increasing marginal 
contributions relative to cost, recursively defined by: i + 1 = argmax^gu] — ^ — , where Si = {1, ... ,i} 
and So = 0. To simplify notations we will denote this order by [n] and write m, instead of ms i _ 1 (i). 
This sorting, in the presence of submodularity, implies that 

mi rri2 m n 

c\ ~ c 2 ~ ~ c n ' 

Notice that v(Sk) = J2i<k m * f° r au ^ ^ W- 

The following greedy scheme is the core of our mechanism (where the parameters denote the set of 
agents A and available budget B/2). 
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Our mechanism for general submodular functions is as follows. 



Random-Mechanism-SM 




1 . Let A = {i | c, ; < B} 


and i* G argmaxi 6j 4 «(i) 


2. with probability ^ , 


return i* 


3. with probability |, 


return Greedy-SM(A, B/2) 



In the above mechanism, if it returns i* , the payment to i* is B; if it returns Greedy-SM(A, B/2), 
the payment is more complicated and is given in [20J. Actually, we do not need this explicit payment 
formula to prove our result. 

Theorem 3.1. Random-Mechanism-SM is a budget feasible universally truthful mechanism for sub- 
modular valuation function with approximation ratio -^j(~ 7.91). 

3.1 Analysis of Random-Mechanism-SM 

In this subsection we analyze Random-Mechanism-SM in terms of three respects: truthfulness, budget 



feasibility and approximation. They together yield a proof for Theorem 3.1 



3.1.1 Universal Truthfulness 

Our mechanism is a simple random combination of two mechanisms. To prove that the Random- 
Mechanism-SM is universally truthful, it suffices to prove that these two mechanisms are truthful, i.e., 
the allocation rule is monotone. 

The scheme where we simply return i* is obviously truthful. Also it is easy to see that prior step 
when we throw away the agents having the cost greater than B does not affect truthfulness. The greedy 
scheme Greedy-SM(A, B/2) is monotone as well, since any item out of a winning set can not increase 
its bid and become a winner. 



3.1.2 Budget Feasibility 

While truthfulness is quite straightforward, the budget feasibility part turns out to be quite tricky. 
The difficulties arise when we compute the payment to each item. Indeed, it can happen that an item 
changes its bid (while still remaining in the winning set) to force the mechanism to change its output. 
In other words, an item can control the output of the mechanism. Fortunately, in such a case no item 
can reduce the valuation of the output too much. That enables us to write an upper bound on the bid 
of each item in case of submodularity; summing up these bounds yields budget feasibility. 

If the mechanism returns i* , his payment is B and it is clearly budget feasible. It remains to prove 
budget feasibility for Greedy-SM(^4, B/2). A similar but weaker result has been proven in [20] using 



the characterization of payments and arguing that the total payment is not larger than B. Here we 
directly show that the payment to any item i in the winning set S is bounded above by ^r • B; then 
the total payment will be bounded by B. Before doing that, we first prove a useful lemma. 

Lemma 3.1. Let S C T C [n] and to = ar g max teT\5 ~ f k ■ Then 

v(T)-v(S) < m s (t ) 



c(T) - c(S) ~ c(t ) 

I 4- In qti fnr nil t CZ. I \ ^ ittq ri QttO _ __ _ 

c(T)-c(S) 



Proof. Assume for contradiction that the lemma does not hold, then for all t G T\S, we have v (T l_ V (c\ > 



ms , \ - , Then add all inequalities together, we have 

v(T)-v(S) HteT\s m s( t ) _ J2teT\s m s(t) 
c(T)-c(S) > £ t6n5 c(t) C ( T )- C ( 5 ) ' 

This implies that v(T) — v(S) > YlteT\s m s(t), which contradicts the submodularity. □ 

Let 1, . . . , k be the order of items in which we add them to the winning set. Let = So C Si C 
• • • C Sk C [n] be the sequence of winning sets that we pick at each step by applying our mechanism. 
Thus we have Sj = [j]. Now, since v is sumbodular, we can write the following chain of inequalities 
(note that marginal contribution is smaller for larger sets). 

msoQ) > rn Sl (2) > > ms^jk) > 2^(5 fc ) 
ci ~~ c 2 ~~ ' c fc ~ B 

The following is our main lemma. 

Lemma 3.2. There is no j G 5" = GREEDY-SM(A, -B/2) swcfo t/iai zt can 6zd more t/ian mg._ 1 (j) /g -, 
and stiW get into a winning set. Thus the payment to j is upper bounded by rns_ 1 (j) —ro \ ■ 

Proof. Assume that there is j G [k] such that it can bid bj > ms-_ 1 (j) , s ■, and still wins. We will use 
notation o instead of c to emphasize that we consider a new scenario where j has increased its bid to bj 
and others remain the same. 

Note that ^a£l > 2*iJ?) > . . . > ms ^ l0) > m \ l0) . Thus 5 7 -_i still get into the winning set. 

c\ — C2 — — Cj — bj J L ° ° 

For bid vector b, denote by S the set we have chosen right before j is included into the winning set. 
Thus we have 

m s{i) m 

7 = arg max — , (1 

msU) > 2v(SU{j}) 
b 3 ~ B ■ ^ 

We may assume that Sk U S 2 S U {j}. Indeed, otherwise S U {j} = S^ U S and 

™Si-iO") > m s (J) > 2t;(SU{i}) > 2t;(S fc ) > v(S k ) 



bj ~ bj ~ B ~ B ~ B 

Thus bj < ms j _ 1 ^Tg-r and we get a contradiction. 

Let R = Sk\ S. Applying equation (1) and Lemma 3.1 to S k U S and 5 U {j}, we know that for 
some ?*o G R\ {j}, 

v{S k US)-v(SU{j}) m Su{j} (ro) < m s (j) 
b(S k US)-b(SU{j}) ~ b(r ) ~ bj ■ 

5 



On the other hand we know that bj > ms j _ 1 (j) v M y Hence, m l < J ns jL " B < ^g^- 
Combining these inequalities, we get 

v(S k US)-v(Su{j}) v(S k ) 
b(S k US)-b(Su{j}) b ■ 



We have b(S k US)- b(S U {j}) = b(R \ {j}) = c(R \ {j}) < c(S k ). 
get 



Recall that ms y W > ^1 for i € [k]. Thus a < ms^i)^^ and c{S k ) = Et=l c W < f • We 



v(S k ) - v(S U {j}) v(S k ) - v(S U {j}) v(S k US)- v(S U {j}) v(S k ) 
B/2 - c(S k ) ~ b(S k US)-b(Su{j}) B ■ 

Thus,v(S k )<2v(Su{j}). 

Recalling inequality (2) on m ^ , we derive 

rnSj-Aj) msti) 2v(S U {j}) i;(g fc ) 
bj ~ bj ~ B B ' 

Hence, we arrive at the contradiction with bj > mg._ 1 (j) M r . D 

3.1.3 Approximation Ratio 

Before analyzing the performance of our mechanism, we consider a simple greedy algorithm (without 
considering bidding strategies): order items according to their marginal contributions and add as many 
items as possible (i.e., it stops when we cannot add the next item as the sum of Cj otherwise will be bigger 
than B). Moreover we can consider the fractional variant of that, i.e., for the remaining budget we take 
a portion of the item at which we have stopped. Let £ be the maximal index for which ^ i=1 £ c% < B. 

Let c' e+1 = B — Yli=i e c i an< ^ m ^+i = rn i.+i • ~r^- Hence, the fractional greedy solution is defined to 
be 



fgre(A) = ^ rm + m' e+1 . 



8=1 



It is well-known that the greedy algorithm is a 1 — 1/e approximation to maximization of monotone 
submodular functions with a cardinality constraint [16]. Also there was shown that the simple greedy 
algorithm has unbounded approximation ratio in case of weighted items with a capacity constraint. 
Nevertheless, a variant of greedy was suggested in [13] which gives the same 1 — 1/e approximation 
to the weighted case. Next we present the following lemma, which is fundamental to our analysis, 
establishing the same approximation ratio for the simple greedy algorithm with fractional solution. 
(The proof is deferred to Appendix [Aj) 

Lemma 3.3. Fractional greedy solution has approximation ratio 1 — 1/e for the weighted submodular 
maximization problem. That is, 

fgre(A) > (1 - 1/e) • opt(A), 

where opt (A) is the value of the optimal integral solution for the given instance A. 

Now we are ready to analyze the approximation ratio of Random-Mechanism-SM. Let T = 
{1, . . . , k} be the subset returned by Greedy-SM(^4, =|). For any j = k + 1, . . . ,£, we have ^- > 



Cfc + 1 



> 



B 



m k+1 ' 2 £* : + 1 1 m l ' 

k + 1. Hence, ey > B 



where the last inequality follows from the fact that the greedy strategy stops at item 



fc+ \ — . Same analysis shows that c' e+1 > B ■ „ k e +i — . Therefore, 



B 



E 



j=k+i m j + m e+i 
k+i 



2E£-> 



< Yj C 3 + ^+1 ^ B - 



j=fc+l 



Which implies that 2^^ m» > J2j=k+i m j + m m an d m fc+i + 2Ei=i m « > ^2j=k+2 m j + m £+i- 



Hence, 



fc+i 



fgre(A) = ^J mj + m^ +1 = ^mj+ ^J ra.,- + m^ +1 < 3 ^J mj + 2m fc+1 < 3 ^J mj + 2u(i*). 

i=fc+2 ies ies 



8=1 



j=l 



Together with Lemma 3.3, we can bound the optimal solution as 



opt (A) < 



e-l 



3Greedy-SM(A, B/2) + 2v{i*) 



(3) 



Therefore, the expected value of our randomized mechanism is |Greedy-SM(j4, B/2) + ^v(i*) > 



e-l 
5e 



opt. 



3.2 Derandomization 

In this section, we provide a deterministic truthful mechanism which is budget feasible and has constant 
approximation ratio (where opt(A \ {i*}, B) denotes the value of the optimal solution for the weighted 
submodular maximization problem given instance A \ {i*} with budget B). 



Mechanism- SM 

1. Let A = {i | c, < B} and i* G argmaxjg^ v(i) 

2. If 1+4e 2 [ v l 1 1 ^ 24e " ■ v(i*) > opt{A \ {i*}, B) ¥\ return 

3. Otherwise, return Greedy-SM(A, B/2) 



Theorem 3.2. Mechanism-SM is a budget feasible truthful mechanism for submodular functions with 
approximation ratio 6e ~ 1 2 ( ( ^ 1 1 t 2 — (~ 8.34). 

Proof. Note that the bid of i* is independent to the value of opt(A\{i*}, B). Therefore, the mechanism 



is truthful (a detailed similar argument is given in the proof of Theorem B.l in Appendix |B[), Budget 



feasibility follows from Lemma 3.2 and the observation that Step 2 only gives additional upper bounds 
on the thresholds of winners from Greedy-SM(A, B/2). 

It remains to prove the approximation ratio. Let x = + C 2(e-i) — ~(~ 7.34). We observe that 
opt(A, B) - v{i*) < opt(A \ {i*}, B) < opt(A, B). 

3 Our deterministic mechanism works in general not in polynomial time because of the hardness of computing an 
optimal solution for submodular maximization problems. However, we may substitute it by the optimum of the fractional 
problem; therefore for special problems like knapsack (discussed in the following subsection), we can get a polynomial time 
deterministic mechanism. Note however that we cannot replace it by the simple greedy solution as it breaks monotonicity. 
Our mechanism suggests a natural question on the power of computation in (budget feasible) mechanism design at the price 
of being truthful |18l IE]. In particular, can an (exponential runtime) mechanism beat the lower bound of all polynomial 
time mechanisms? We leave this as future work. 



If the condition in Step 2 holds and the mechanism outputs i* , then 

opt(A, B) < opt(A \ {i*},B) + v(i*) < (x + 1) ■ «(»*). 

Otherwise, the condition in Step 2 fails and the mechanism outputs Greedy-SM(j4, B/2) in Step 3. 
Recall that in formula (3), opt(A,B) < ^(^GREEDY-SM^, B/2) + 2v{i*)\ We have 



x ■ v{i*) < opt(A \ {i*}, B) < opt(A, B) < -^—- (3Greedy-SM(A, B/2) + 2v{i* 
This implies that v(i*) < x(e _ 3 1 e ) _ 2e GREEDY-SM(A,^/2). Hence, 

opt < — %■ ( 3Greedy-SMM, B/2) + 2v(i*)) < -?—■ ( 3 + — —, ) • Greedy-SMM, B/2). 

e — 1\ / e — 1 \ x(e — 1) — 2e ) 

Simple calculations show that 1 + x = 6e ~ 1 2 |" ( }_ ] t 24e = ^§j ( 3 + a(e _ 6 1 e ) _ 2e ) • Therefore, we have 
opt < (x + 1) • GREEDY-SM(yl, B/2) in the both cases, which concludes the proof of the claim with 
approximation ratio ^-j- ( 3 + x ( e _ 6 1 6 ) „ 2e ) (~ 8.34). □ 

3.3 Improved Mechanisms for Knapsack 

In this subsection, we consider a special model of submodular functions where the valuations of agents 
are additive, i.e., v (S) = Y2ies Vi ^ or ^ — W - This leads to an instance of the Knapsack problem, where 
items correspond to agents and the size of the knapsack corresponds to budget B. Singer [20] give a 
6-approximation deterministic mechanism. By applying approaches from the previous subsections, we 
have the following results (proofs are deferred to Appendix [B[) . 

Theorem 3.3. There are 2 + \[2 approximation deterministic and 3 approximation randomized poly- 
nomial truthful budget feasible mechanisms for knapsack. 

4 Lower Bounds 

In this section we focus on lower bounds for the approximation ratio of truthful budget feasible mech- 
anisms for knapsack. Note that the same lower bounds can be applied to the general submodular 
functions as well. In |20J, a lower bound of 2 is obtained by the following argument: Consider the case 
with two items, both of unit value (the value of two items together is 2). If their costs are {B — e, B — e), 
at least one item should win, otherwise the approximation ratio is infinite. Without loss of generality, 
we can assume that the first item wins, then its payment is at least B — e. Now consider another profile 
(e, B — e), the first item should also win and get payment at least B — e by truthfulness. Then the 
second item could not win because of the budget constraint and individual rationality. Therefore, the 
mechanism can only archieve value 1 for that instance while the optimal solution is 2. This gives us the 
lower bound of 2. 

We improve the deterministic lower bound to l+\/2 by a more involved proof. We also adduce a lower 
bound of 2 for universally randomized truthful mechanisms. All our lower bounds are unconditional, 
which implies that we do not impose any complexity assumption and constraints of the running time 
on the mechanism. Our lower bounds relys only on truthfulness and budget feasibility. 



4.1 Deterministic Lower Bound 

Theorem 4.1. There is no truthful budget feasible mechanism that can achieve an approximation ratio 
better than 1 + y/2, even if there are only three items. 

Assume otherwise that there is a budget feasible truthful mechanism that can achieve a ratio better 
than 1 + y/2. We consider the following scenario: budget B = 1, and values v\ = \/2, V2 = V3 = 1. 
Then the mechanism on a scenario has the following two properties: (i) if all items are winners in the 
optimal solution, the mechanism must output at least two items; and (ii) if {1, 2} or {1,3} is the optimal 
solution, the mechanism cannot output either {2} or {3} (i.e., a single item with unit value). For any 
item i, let function Pi(cj, c&) be the payment offered to item i given that the bids of the other two items 
are Cj and C&. That is, Pi(cj, c&) is the threshold bid of i to be a winner. 

Lemma 4.1. For any C3 > 0.5 and any domain (a,b) C (0, 1 — C3), there is c<i G (a, b) such that 
Pi(c 2 ,c 3 ) < 1 -c 2 . 

Proof. Assume otherwise that there are C3 > 0.5 and domain (a, b) C (0, 1 — C3) such that for any 
C2 G (a, b), pi (02,03) > 1 — eg. Let c\ = 1 — C3 — 6, then ci + 02 + C3 < 1 = B, which implies that 
the mechanism has to output at least two items. Since c\ = 1 — C3 — b < 1 — 02 < p\ (02,03), item 
1 is a winner. Further, p\ (02,03) > 1 — 02 > 0.5, which together with budget feasibility imply that 
item 3 cannot be a winner. Therefore, item 2 must be a winner with payment ^2(01,03) = 02 due to 
individual rationality and budget feasibility. The same analysis still holds if the true cost of item 2 
becomes c 2 = ^~, i.e., item 2 is still a winner with payment c 2 . Thus for the sample (01,02,03) the 
payment 2*2(01,03) > c' 2 > 02, a contradiction. □ 

Since item 2 and 3 are identical, the above lemma still holds if we switch item 2 and 3 in the claim. 



We are now ready to prove Theorem 4.1 



Proof of Theorem 4..I. Define 03 = 0.7 and (a, b) = (0.2,0.3). Note that 03 and (a, b) satisfy the 



condition of Lemma 4.1. Hence, there is c G (0.2,0.3) such that pi(c, 0.7) < 1 — c. Define pi(c, 0.7) 



1 — c — x, where x > 0. Symmetrically, define 02 = 0.7 and (a',b') = (c, min{0.3, c + x}). Again by 



Lemma 4.1 , there is d £ (a', b') such that pi(0.7, d) < 1 — d. Define pi(0.7, d) = 1 — d — y, where y > 0. 
Pick c\ = 1 — d — e, where e > is sufficiently small so that c\ G (1 — c — x, 1 — c) n (1 — d — y, 1 — d). 
Note that since d G (c,c + x), c\ is well-defined. 

Consider a true cost vector (ci, c, 0.7). Since pi(c, 0.7) = 1 — c — x < ex, item 1 cannot be a winner. 
Since ci + c=l — d — e + c< 1, the optimal solution has value at least v\ + U2 = 1 + V^; therefore the 
mechanism has to output both item 2 and 3. Hence, 2*3(01, c) > C3 = 0.7. 

Similarly, consider true cost vector (ci,0.7, d); we have p2(cx,d) > C2 = 0.7. Finally, consider cost 
vector (ci, c, d). By the above two inequalities, both items 2 and 3 are the winners; this contradicts the 
budget feasibility. □ 

4.2 Randomized Lower Bound 

Theorem 4.2. There is no randomized (universally) truthful budget feasible mechanism that can achieve 
an approximation ratio better than 2, even in case of two items. 

Proof. We use Yao's min-max principle, which is a typical tool used to prove lower bounds. By the 
principle, we need to design a distribution of instances and argue that any deterministic budget feasible 
mechanism cannot get an expected approximation ratio which is better than 2. 

All the instances contain two items both with value 1. Their costs (01,02) are drawn from the 
following distribution (see Fig. p]in Appendix): 



1. (™, ( " w fc)B ) with probability £=§ , where fe = 1,2, . . . ,n- 1, 

2 - (lT> ^) with probability ( n-1 )( n _ 2 ) , where z, j G {1, . . . ,n - 1} and i + j > n, 

where 1 > e > and n is a larger integer. 

We first claim that for any deterministic truthful budget feasible mechanism with finite expected 
approximation ratio, there is at most one instance, for which both items win in the mechanism. Assume 
for contradiction that there are at least two such instances. Note that for the second distribution 
( — , — ), where i + j > n, it cannot be the case that both items win due to the budget constraint. 

Hence, the two instances must be of the first type; denote them as ( - J ^, ^ n ~ — ) and i- 2 — , ~ 2 ' ), 
where k\ > A>2- Consider then the instance ( ^— , ~ ) • Since k± + n — &2 > n, this is the instance of 
the second type in our distribution. Therefore it has nonzero probability (see fig. [Tj) . The mechanism has 
finite approximation ratio, thus it should have finite approximation ratio on the instance (-t-, n 2 ) 
as well. As a result, it cannot be the case that both items loss. We assume that item 1 wins (the 
proof for the other case is similar); the payment to him is at least -^— due to individual rationality. 
Then consider the original instance (-^— , n )i it em 1 should also win and get a threshold payment, 
which is equal to or greater than - J ^. Therefore the payment to second item because of the budget 
constraint is at most B — = n ~ x> . Since ^ n ~ — < (n ~ 2) , we arrive at a contradiction with 

n n n n ' 

either individual rationality or assumption that both items won in the instance (-^-, n )• 

On the other hand, for all instances (-^-, n ), both items win in the optimal solution with value 
2. Hence, the expected approximation ratio of any deterministic truthful budget feasible mechanism is 
at least ^5f ■ 1 + (n — 2) • ^5f -2 + e-l = 2 — e— ^j- . The ratio approaches to 2 when e — > and n — > oo. 
This completes the proof. □ 

5 Beyond Submodularity 

A natural generalization of knapsack is to consider heterogeneous items. That is, we are given m 
different types of items and each item has a (private) cost Cj and a (public) value Vi, as well as an 
indicator U S [m] standing for the type of item i. The goal is to pick items of different types (i.e., one 
cannot pick more than one item of the same type) to maximize total value given a budget constraint 
B. The knapsack problem studied in the last section is therefore a special case of the heterogeneous 
problem when all items are of different types. However, we cannot simply apply the mechanisms for 
knapsack here because of heterogeneous items. (Notice however that the lower bounds established in 
the last section still work.) 

The main difference of this problem with knapsack or general submodular functions is that here not 
every subset is a feasible solution. A straightforward greedy could end up with a very poor solution: 
Consider a situation that every type contains one very small item (both Vi and Cj are very small) but 
with large value cost ratio ^; greedy will take all these small items first and therefore not be able to take 
more since each type already has one item. The overall value of this greedy solution can be arbitrarily 
bad compared to the optimal solution. 

To construct a truthful mechanism for heterogeneous knapsack, we employ a greedy strategy with 
deletions. The main idea is that at every time making a greedy move, we consider two possible changes: 
(i) add a new item whose type has not been considered before, and (ii) replace an existing item with 
the new one of same type. Among all the possible choices (of two types), we greedily select items with 
highest value cost ratio: In the case of adding a new item, its value cost ratio is defined as usually ^ L . 
For the replacement case where we replace i with j, its marginal value is Vj — Vi and marginal cost is 
Co — Cj, and hence its value cost ratio is defined to be J ' . 
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As before, now we assume that all the items are ordered according to their appearances in the 
greedy algorithm (note that some items never appear in the algorithm and we simply ignore them). 
The following greedy strategy is similar to what we did for the knapsack problem. In Appendix [Cj we 
prove that it is monotone (therefore truthful) and budget feasible. (Here for notation simplicity, we 
assume that we already take an item with c = and v = for each type, thus every greedy step can be 
viewed as a replacement.) 



Greedy-HK 
















1. 


Let k= 1, 5 = 0, and 


last[j] 


= 


for j 


€ [m 


} 






2. 


While k < \A\ and c(k) 


— c(last[tk]) 


< B ■ 




v(k)- 


-v(last[tk]) 




v(k)- 


v(last[t k ])+J2i,zs 


v(i) 




• let 5 f- (S \ {last[t k }}) U 


{k} 














• let last[t).] = k 


















• let k <- k + 1 
















3. 


Return winning set S 

















By applying the above Greedy-HK, we have the following claim for heterogeneous knapsack. (De- 
tails can be found in Appendix [C]) 

Theorem 5.1. There are 2 + v2 approximation deterministic and 3 approximation randomized poly- 
nomial truthful budget feasible mechanisms for knapsack with heterogeneous items. 

Finally, we comment that greedy is typically the first choice when we consider designing truthful 
mechanisms because it usually has a nice monotone property. However, when we allow cancelations 
in the greedy process, its monotonicity may fail. In the heterogeneous knapsack problem, fortunately 
Greedy-HK is still monotone (although its proof is much more involved) and therefore we are able to 
apply it to design truthful mechanisms with good approximation ratios. Our idea sheds light on the 
possibility of exploring budget feasible mechanisms in larger domains beyond submodularity. 
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Figure 1: distribution for n = 6 



A Proof of Lemma 3.3 



Proof. Assume that all weights Wi are integers. We reduce our weighted problem with monotone sub- 
modular utility function u to the unweighted one as follows. 

• For each item i S [n] we consider new W{ items of unit weight. Denote them as ij for j £ [wi] and 
call i to be the type of the unit ij . 

• We make the new valuation function v depends only on the amounts of unit items of each type. 

• Let a set S contains aj units of each type i. Independently for each type pick at random in the 
set TZ with probability rr weighted item i. Define f(S) = E(u(1Z)). 



Therefore 



u(S) 



W\ 



W r 



^u(S-n) 



where tt is a sampling of units one for each type (there are w\ ■ . . . ■ w n variants for it); S ■ it is a vector 
of types at which n hits S. 

Using this formula it is not hard to verify monotonicity and submodularity of v. Indeed, e.g. to 
verify submodularity one only need to check that the marginal contribution of any unit is smaller for a 
large set, i.e. for S C T and ij ^ T verify inequality u(S n {ij}) — v(S) > v(T n {ij}) — v(T), which is 
pretty straightforward. 

For any T C [n] if we consider a set of units S = {ik\i E T,l < k < Wi}, then according to the 
definition v(S) = u(T). Hence, optimal solution to the unit weights problem is large or equal than the 
optimal solution to the original problem. 

To conclude the proof it is only left to show that the greedy scheme for the unit weights gives us 
the same result as our fractional greedy scheme for an integer weights. Note that once we have taken a 
unit of type i we will proceed to take units of type i until exhaust it completely (we brake ties in favor 
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to the last type we have picked). Indeed, let *fc » *fe-t-i ^ 5 then 

i/(5 U {**})- i/(5) = K<5U{i fe+1 })-i/(5) 

i 

^ u(S(J{i k+1 } -vr) -u(S-tt) 

{7r|*fe+ie7r} 

^ u(SU{4,i w } -vr) -n(5u{i fc } • vr) 

{7r|*fe+ie7r} 

z^(5 U {i fc , ifc+i}) - v(S U {i fe }) 



iui • . . . • w r , 

1 

w± ■ . . . ■ w n 



Therefore, marginal contribution of the type i does not decrease if we include in the solution units 
of type i. On the other hand, because v is submodular, marginal contribution of any other type can 
not increase. So we will take unit ik+i right after i k . 

Assume we already have picked set 5 and now are picking the first unit of a type i. Hence, S 
comprises all units of a type set T. Then we have 



u(SU{h})-v(S) 



rriT{i) 



1 V" ra^f-x \ ra \ Hfc^ w k m T {i) 

> u (6 U {ii\ • n) — u (6 • it) = rTn jtitW ~ 



nn 
k=l w k 



{7r|iie7r} 



nn ' 

k=l w k 



W; 



Thus i = argmaxutT — which coincides with the rule of our fractional greedy scheme. 
In case of real weights the same approach can be applied but in more tedious way. 



□ 



B Mechanisms for Knapsack 

In this section, we describe our deterministic and randomized mechanisms for knapsack, yielding a proof 
for Theorem 13.31 



B.l Deterministic Mechanism 

We consider the following greedy strategy studied by Singer [20] . 



Greedy-KS(A) 




1. Order all items in A s.t. a > ^ > ■ 

ci — c 2 — 


~ C| A | 


2 . Let k = 1 and S = 




° Uh-ilr h ^ 1 \ 1 -mrl r, '" R Vk 




2^iesu{k} v i 


• S^SU{k} 




• k <r- k + 1 




4 . Return winning set S 





It is shown that the above greedy strategy is monotone (and therefore truthful) . Actually, it has the 
following remarkable property: any i £ S cannot control the output set given that i is guaranteed to be 
a winner. That is, if the winning sets are 5 and S' when i bids Cj and c^, respectively, where i £ S D S' , 
then S = S' . Otherwise, consider the item iq ^ S n S' with the smallest index; assume without loss of 
generality that io £ S \ S' . Let T = {j G S n S' \ j < io,j ^ i} be the winning items in 5 n 5' \ {i} 



14 



before iq . Then a n < B ■ ^ z ° — < B ■ ^ '° — , which implies that io should be a winner in S' as 

2^jes v i l^j£T v J< v i> v ia 

well, a contradiction. 

Given the greedy strategy described above, our mechanism for knapsack is as follows (where fopt(A) 
denotes the value of the optimal fractional solution; for knapsack it can be computed in polynomial 
time). 



Mechanism-KS 




1. 


Let A = {i 


C-i < B} and i* G argmaxig^ m 


2. 


If (1 + V2) 


• v i* > fopt(A \ {i*}) , return i* 


3. 


Otherwise, 


return S = Greedy-KS(A) 



Theorem B.l. Mechanism-KS is a 2 + V2 approximation budget feasible truthful mechanism for 
knapsack. 

Proof. The proof consists of each property stated in the claim. 

• Truthfulness. We analyze monotonicity of the mechanism according to the condition of Step 2 
and 3, respectively. If i* wins in Step 2 (note that the fractional optimal value computed in Step 2 
is independent of the bid of i*), then i* still wins if he decreases his bid. 

If the condition in Step 2 fails and the mechanism runs Step 3, for any i G S, the subset S remains 
the same if i decreases his bid. Note that if i ^ i* , when i decreases his bid, the value of the 
fractional optimal solution computed in Step 2 will not decrease. Hence i is still a winner, which 
implies that the mechanism is monotone. 

• Individual rationality and budget feasibility. If i* wins in Step 2, his payment is the threshold bid 
B. Otherwise, assume that all buyers in A are ordered by 1, 2, . . . , n; let S = {1, . . . , k}. Note 
that it is possible that i* G S. For any i G S, let qi be the maximum value that i can bid such 
that the fractional optimal value on instance A \ {i*} is still larger than Vi*. Note that Cj < qi. 

The payment to any winner i G S \ {i*} is pi = min < vi • ^^-,B- ^ Vi , qi \ , and pi* = 
min < Vi* • ^^-,B ■ ^ Vi * — > if i* G S. It can be seen that the mechanism is individually ra- 
tional. Further, ^2 i£ gPi < SieS -^ ' v~^~~ = ^' wn i cn implies that the mechanism is budget 
feasible. 



Approximation. Assume that all buyers in A are ordered by 1,2, ... ,n, and T = {1, . . . , k} is the 
subset returned by Greedy-KS( j 4). Let £ be the maximal item for which £^ =1 £(H < B. Let 



c 



j 



B — J2i=i e c i an( i v 'e.+i = w ^+i ' S^^- Hence, the optimal fractional solution is 



e+i — " L^i=i,...,i ^ aiLU u e+i ~ u *+ 1 c e+1 

e 
fopt(A) = Y^Vi + v' e+1 
i=i 

For any j = k + 1, . . . , £, we have ^ > ^p^ 1 > — — • B ■ ^+1 , where the last inequality follows 

j k-\-l k-\-l Z-^ii = \ ^i 

from the fact that the greedy strategy stops at item k + 1. Hence, Cj > B ■ k ^ — . Same analysis 
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shows c' e+1 > B ■ -jffi . Therefore, B ■ J2j= ^ +V ' e+1 < Y?j=k+i c j + c 'e+i < B > which im p!ies 



that Ya=i v * > ELfc+2 V J + *4fi- Hence, 



ES»< 



fopt(A) = ^2 v i + ^+1 < 2 X! ^ » + ^ 



i=l 



A basic observation of the mechanism is that 

fopt(A) - Vi * < fopt(A \ {i*}) < fopt(A) 

Hence, if the condition in Step 2 holds and the mechanism outputs i* , we have 

fopt(A) < fopt(A \ {i*}) + Vi . < (2 + V2) ■ Vi * 

If the condition in Step 3 fails and the mechanism outputs S in Step 4, we have 

(1 + V2) ■ Vl * < fopt{A \ {i*}) < fopt(A) <2j2vi + Vi* 

ieS 

which implies that v^ < v2 • X^eS v *- Hence, 

opt < fopt(A) = ^ Vi + v' e+1 < 2 Y^ ^ + v^ < (2 + \/2) • ^ v t . 

i=l,...,£ ieS i&S 

Therefore, the mechanism is (2 + y/2) approximation. 



B.2 Randomized Mechanism 

Our randomized mechanism for knapsack is as follows. 

Random-Mechanism-KS 

1. Let A — {i | a < B} and i* G argmaxig^ m 

2. With probability ~, return i* 

3. With probability |, return GREEDY-KS(yl) 



D 



Theorem B.2. Random-Mechanism-KS is a 3 approximation universal truthful budget feasible mech- 
anism for knapsack. 

Proof. Since both mechanisms in Step 2 and 3 are budget feasible and truthful, it is left only to prove 
approximation ratio. 



Using the same notation and argument in the proof of Theorem |B.1[ assume that all buyers in A 
i ordered by 1, 2, . . . , n, am 
ximal item for which 2»=] 
optimal fractional solution is 



are ordered by 1, 2, . . . , n, and T = {1, . . . , k} is the subset returned by Greedy-KS(^4). Let £ be the 
maximal item for which Ej=i e c i — &• Let c' e+1 = B — ^2 i=1 £ c% and v' i+1 = c' e+1 ■ ^r^-- Hence, the 



fopt(A) = J2 v i + v 'e+i 



i=l 
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and 

i 

fopt(A) = y' j v i + v ' l+1 <Vi* +2^Vi. 

The excepted value of Random-Mechanism-KS is therefore 

1 2^ 1/ v-^ \ 1 

3 U »* + 3 Z> Vi = 3 (^* + 2 l^ Vi ) > 3°^ 

which completes the proof. □ 

C Knapsack with Heterogeneous Items 

In this section we analyze heterogeneous knapsack problem and Greedy-HK, which leads to a proof 
of Theorem 15.11 



C.l Optimal Fractional Solution 

We start our study again on fractional solutions to the optimization problem. First we have to define 
what is a fractional relaxation for heterogeneous knapsack or more precisely what is a feasible fractional 
solution. 

Definition C.l. A feasible solution for heterogeneous knapsackis ann-tuple of real numbers (a±, . . . ,a n ) £ 
[0, l] n satisfying Y11=i a i c i — B and ^2 iet - on < 1 for any j € [m]. An optimal fractional solution is a 
feasible solution that maximizes Y^7=i aiVi - 

We have the following observation on optimal solution. 
Lemma C.l. For a given budget B we can pick an optimal fractional solution foPT such that 

• there are at most two nonzero amounts of items of any type in foPT ■ 

• there is exactly one item of any type in foPT except maybe only for one type. 

Proof. Consider any optimal solution f OPT - Fix the price pj spent on the particular type j in it. We 
can use only two items of type j in order to provide the maximum value for the price pj. Indeed, if 
one draws all items of type j in the plain with x-coordinate corresponding to the cost and y-coordinate 
corresponding to the value of an item together with the point (0,0), then the condition Yl iet - cti < 1 

will describe a point in the convex hull of the drawn set. 

Thus we can take foPT with at most two items of a type and derive the first part of the lemma. 

One can derive the second part of the lemma by changing pj t and pj 2 in foPT such that pj t + pj 2 
remains constant. Indeed, appealing to the picture again, we consider two convex polygons Pi and P2 
for the types j\ and ji- If both prices pj ± and pj 2 get strictly inside the corresponding sides of those 
polygons, then by stirring pj 1 and pj 2 in foPT with keeping pj x +Pj 2 constant we can get to a vertex of 
Pi or Pi and do not decrease the total value. □ 

The following algorithm computes an optimal fractional solution for heterogeneous knapsack. (For 
convenience we add an item numbered by of a new type with cost and value 0; this does not affect 
any optimal solution.) 
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Figure 2: Convex hull 



Fraction-HK 




1 . For each type j G [m] , (partially) order items of type j as follows : 




• let last = 0, tg = and A, = 




• while v(last) < maxii(i) 
ietj 




— let fc = argmax _.,- ?}-l~ V n a3 J, and add fc to An 

define tg k = | e ^_ c( \ ast) '| 

— let ^asi = fc 




2. Comprise all Aj into one big set A and order all items s.t. tg± > ■ 


• > tg\A\ 


3. Let last[j] = for each j G [to] , on = for each i G [n] and k = 1 




4. While fc < |A| and c k + YnZl a t ■ a < B 




• let aiast[t k } «- 




• let last[tk] -s— fc, ttfe •<— 1 




• let fc <— fc + 1 




5. If fc < \A\, then let a fe = £^± and aj ost [ tfc ] = 1 a k 




6. Return vector (aj)jg[ n i 





Theorem C.l. Fraction-HK computes an optimal fractional solution for heterogeneous knapsack. 
Proof. 

• If we draw every item i G tj U {0} as a point (ci,Vi) in the plain (see fig. 2h, then all picked items 
in Aj will correspond to the part of convex hull's vertices of the drawn set from (0, 0) to the item 
with maximal value. Computed value of tg will correspond then to the tangent of the side of the 
convex hull with the right end at the given item. 
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As in the proof of lemma C.l one can find the optimal value, that we can get for a type j at the 
price c, by taking the y-coordinate of the point on a side of convex hull with c at x-coordinate. 
Thus for the optimal fractional solution we only need items from A 



UjAj. 



• Taking everything above into account we can reduce the heterogeneous knapsack to the basic 
knapsack problem. Fix a type j and construct the instance of the reduced problem Kj as follows. 
For each item k E Aj assign the cost C& := c& — c{last[tk\) and the value v^ := Vk — v(last[tk\). 
It is easy to see that optimal solution to basic knapsack problem Kj gives the same value as 
the solution to the original heterogeneous problem restricted to the items of type j for any given 
budget. Hence the optimal fractional solution to basic knapsack problem UjKj has the same value 
as the optimal fractional solution to the original problem. 

• Now it easy to check that our algorithm at stages 2 — 5 computes the optimal fractional solution 
to the reduced knapsack problem and thus finds the optimal fractional solution to our original 
problem. 

□ 

C.2 Greedy Strategy with Deletions 

We consider the following greedy strategy mechanism. 



Greedy-HK 
















1. 


Take the same ordered 


set A 


as 


in St 


ep 2 


of 


Fraction-HK 


2. 


Let k = 1 , 5 = 0, and 


last[j] 


= 


for j 


G [m 








3. 


While k < \A\ and c(k) 


— c(lasi 


[**]) 


< B ■ 




v(k)- 


-v(last[t k }) 




v(k)- 


v(last[t k ])+J2 i€S 


v(i) 




• let 5 f- (5 \ {last[t k }}) U 


{k} 














• let last[tk] = k 


















• let k 4— k + 1 
















4. 


Return winning set S 

















\c(k)-c(last[t h ])\ ' WX1 l - 



Recall the notation in the algorithm Fraction-HK, tgj. 
item of type t^ in A at the moment when we are about to add k into A. Define S^ 
Then the second condition in Step 3 of Greedy-HK can be rewritten as 



fej is the last 
(S\{last[t k ])U{k}. 



tgk > 



v(Sk) 
B 



We next analyze the mechanism Greedy-HK. Let us denote by M.^ the run of mechanism Greedy-HK 
on bid b (with the corresponding ordered set At,, the last item of each type lastb[tk] an d marginal tangent 
tg k (M b )). 

Claim C.l. Greedy-HK is monotone (and therefore truthful). 

Proof. We will show that any losing item cannot bid more and become a winner. Assume otherwise 
that item j loses with bid Cj but wins with bid bj > Cj, given that all others bid Cj, i ^ j. 

Note that when j changes his bid, it will only affect the convex hull of items in tj U {0}. The 
following observations can be verified easily (see fig. ^J: 
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1. Values v(S) of the set of winners and v(last[t k ]) for each type t k , taking dynamically in the process 
of the mechanism, keep increasing. 

2. Value tg,j decreases when j increases its bid (since point (bj,Vj) is on the right hand side of point 

(Cj,Vj)). 

3. Ordered set A b \ tj is the same as ordered set A c \ tj 

By considering the convex hull for t~ , one can easily see that if j was not getting at any moment in 
the winning set S in M c it also will never get in the winning set in Mb- 

Let us explain why for j increasing its bid can not help to remain in the winning set if for the current 
cost Cj it has been dropped off. 

Note that in the new ordered set Af,, there can be new items of the same type as j (e.g. last c [j] can 
be different from lastb[j]), but nevertheless tgj(Mb) < tgj(M c ). Let j' £ t~ be the item that substitutes 
j in M c , then tgj>(M c ) < tgj>(Mb) (note that j' necessarily appears in Ab). Let k be an item at which 
Mb has stopped, i.e. the first item that we have not taken in the winning set. Assume k stands in Af, 
not further than j'. Consider two cases. 

1. Let tk 7^ tj. Then 

• tg k (M c ) = tg k {M b ) 

• v(Sji(M c )) > v(S k (Mc)), as j' stands later than k in A c 

• v(Sk(M c )) = v(Sk(Mb)), since in both Sk(Mb) and Sk(A4 c ) for tj type we have taken j as 
well as for each other type we have taken the same item. 

2. tk = tj. Then 

• tg f {M c ) < tgj,(M b ) < tg k (M b ) 

• v(Sji(M c )) > v(Sk(Mb))- The last equality holds true, because for each type the value of 
the item in Sj>(M c ) is greater or equal than value of the corresponding item in Sk{M.b)- 



In both cases we can write 

tg k {M h ) > tgj'(Mb) > tg f (M c ) > "^r^""' > 



v(SjiM c )) v(S k (M b )) 

J-K^'hl ^ >!Jj W'.-( - B — B 



Thus we have to take k in Mb to the winning set. Hence we arrive at a contradiction. Hence we 
have taken j' to the winning set in Mb and therefore exclude j. □ 

Unfortunately, in contrast to knapsack case this scheme does not possess the following property: 
any i 6 S cannot control the output set given that i is guaranteed to be a winner. 

Claim C.2. Let S be the winning set of Greedy-HK on cost vector c. Then no item j G S can be 
remained a winner with bid bj satisfying 

ID 

b j > ( v ti) ~ v(last c [tj])) ■ —jr + c{last c [tj\) 

Proof. Assume to the contrary that there exist such j and bid bj. We can write 

= v{j) - v(last b [tj]) < v(j) - v(last c [tj}) v(S)_ 
j[ b> bj - c(last b [tj}) ~ bj - c{last c [tj\) B 
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Consider the ordered set A c and let k be the last item we have taken in the winning set in Ai c . 
Now consider any item i G [l,fc] where tj ^ ti. We have ^^ < tgk(A4 c ) < tgi(M. c ) = tgi(Adb). By 
the assumption that j is in the winning set in Mb and tgj(Mb) < ^p < tgi(Mb), we get that Sj(Mb) 
contains an item i' with ti = fy and v{i') > v{i). Since j is in 5 and in Sj(Mb) we get v (Sj(Mb)) > -y ('S')- 
Hence 



which gives a contradiction. 

Claim C.3. Greedy scheme Greedy-HK is budget feasible. 



□ 



Proof. Let S 1 be a winning set for M. By Claim C.2 we have an upper bound on the payment pj to 
each item j G S, i.e., 

Pi < (v(i) - v(last c [tj])) ■ —— + c(ias< c [tj-]) 
Let = io,i\, . . . ,i r , i r +i = j be the items of type tj that have appeared in the winning set. We have 



tgi, > 



"(g) 



for each £ = 1, . . . , r. Hence 



c(ie) ~ c(U-i) < (v(ie) ~ v(it-i)) 



B 



Now if we sum up the above inequalities on c{i{) — c(i/_i) for all £ = 1, . . . , r and plug it in the bound 
on pj , we get 



Pj 



< 



B 

vJS) 



r+l 



i e ) - v{i i _i J 



v{j) 



B 



Therefore, ^2~ £ sPj — ^i w hich concludes the proof. 



□ 



C.3 Mechanisms 

Given the greedy strategy described above, our mechanism for heterogeneous knapsack is as follows. 



Mechanism-HK 












1. 


Let A = {i 


a 


<B} 


and i* G argmax^ 


£AVi 




2. 


If (1 + V2) 


■ Vl 


> Fraction-HK(A \ {i 


*}). 


return i* 


3. 


Otherwise, 


return S 


= Greedy-HK 







Theorem C.2. Mechanism-HK is a 2 + \[2 approximation budget feasible truthful mechanism for 
heterogeneous knapsack. 

Proof. The proof consists of each property stated in the claim. 

• Truthfulness. The same proof as for knapsack also works here. 

• Individual rationality and budget feasibility. If i* wins in Step 2, his payment is the threshold bid 
B. Otherwise, payment to each item has an upper bound from the payment rule in Greedy-HK 



and thus according to the claim C.3 final total payment will be below given budget B. 
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Approximation. Return back to the algorithm for optimal fractional heterogeneous knapsack. 
Consider the stage where we add item fc to a set Aj, let us define v{k) = v(k) — v(last[tk\) and 
c(k) = c(k) — c(last[tk\) to be modified value and cost of item k. Let us consider fractional 
knapsack FK problem for those modified costs and values for all items in A. It turns out that 
for any budget this new problem FK has the same answer as initial heterogeneous knapsack HK. 
Note that our greedy scheme Greedy-KS for modified costs and values and our greedy scheme 
Greedy-HK for original heterogeneous knapsack also give the same answer. Thus applying the 



part approximation of claim B.l to the modified problem we obtain desired bound. 



□ 



We can also have the following randomized mechanism with approximation ratio of 3 (its proof is 



similar to Theorem B.2). 



Random-Mechanism-HK 




1 . Let A = {i | a < B} 


and i* G argmaxjg^ t^ 


2. With probability \, 


return i* 


3. With probability |, 


return S = Greedy-HK 



Theorem C.3. Random-Mechanism-HK is a 3 
mechanism for heterogeneous knapsack. 



approximation universal truthful budget feasible 
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